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The Nucleus Accumbens (NAcc) is an important structure for the transfer of information 
between cortical and subcortical structures, especially the prefrontal cortex and the 
hippocampus. However, the mechanism that allows the NAcc to achieve this integration 
is not well understood. Phase-amplitude cross-frequency coupling (PAC) of oscillations 
in different frequency bands has been proposed as an effective mechanism to form 
functional networks to optimize transfer and integration of information. Here we assess 
PAC between theta and high gamma oscillations as a potential mechanism that facilitates 
motor adaptation. To address this issue we recorded intracranial field potentials directly 
from the bilateral human NAcc in three patients while they performed a motor learning 
task that varied in the level of cognitive control needed to perform the task. As in rodents, 
PAC was observable in the human NAcc, transiently occurring contralateral to a movement 
following the motor response. Importantly, PAC correlated with the level of cognitive 
control needed to monitor the action performed. This functional relation indicates that the 
NAcc is engaged in action monitoring and supports the evaluation of motor programs 
during adaptive behavior by means of PAC. 
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1. INTRODUCTION 

The nucleus accumbens (NAcc) is part of the ventral striatum 
and plays a pivotal role in integration of information (Goto et al., 
2008) from the limbic system, particularly between the prefrontal 
cortex (PFC) and the hippocampus (HC). The NAcc is considered 
the interface by which the HC gates input from the prefrontal cor- 
tex (French et al., 2002). In rats the PFC and HC converge onto 
single NAcc-neurons (Finch et al., 1996; Goto et al., 2008) and the 
PFC-NAcc and HC-NAcc connections are mutually dependent. 
For instance, long term potentiation of the HC-NAcc associa- 
tion entails a long term depression of the PFC-NAcc association 
(Grace et al., 2007). It is assumed that this selective strengthening 
of the HC-NAcc connection is important for the rapid facili- 
tation of goal-directed behaviors and for supporting automized 
actions (Goto et al., 2005; Belujon et al., 2008). Such automized 
actions are especially evident in motor learning tasks in which 
the NAcc integrates information for the planning of movements 
(Mogenson et al, 1980; Grace et al., 2000). Miinte et al. (2007) 
speculated that the human NAcc evaluates the information used 
for the adjustment of response strategies. Accordingly, lesions in 
the NAcc limit the flexibility required for changes in behavior dur- 
ing learning (Grace et al., 2007). However, knowledge about the 
specific neural mechanisms utilized to integrate information from 
the PFC and the HC in the human brain is still limited. 



Phase-amplitude cross-frequency coupling (PAC) of oscilla- 
tions has been suggested as an effective mechanism for recruiting 
local networks to form functional global networks and to gate 
information (Buzsaki et al, 2004; Canolty et al, 2006, 2010; 
Cohen et al, 2009; Staudigl et al., 2012). PAC describes the depen- 
dency of the amplitude of a high frequency on the phase of a low 
frequency. In rats and mice there is a tight connection between 
the phase of the theta band (9) of local field potentials (LFP) and 
single unit activity (SUA) (Chrobak et al, 1998; Sirota et al., 2003; 
Siapas et al., 2005) presumably allowing neurons to form a larger 
assembly of neurons by means of transient coupling (Chrobak 
et al., 1998). These studies suggest that the interaction between 
PFC and HC may occur via PAC. O'Donnell et al. (1995) showed 
that hippocampal hyper- and depolarization leads to hyper- and 
depolarization in the NAcc. In the state of depolarization neurons 
in the NAcc are more likely to fire action potentials in response 
to stimulation of the PFC (French et al, 2002; Goto et al, 2008) 
providing evidence for PAC with an enhancement of high fre- 
quency amplitudes during troughs in 9 activity. Tort et al. (2008) 
showed transient G phase — high gamma (y) coupling in the rat's 
striatum during movement through a maze. Furthermore, Tort 
et al. (2009) demonstrated a function link between performance 
improvement and the strength of theta-gamma coupling dur- 
ing the course of learning. However, until now it has not been 
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established whether NAcc shows PAC between 9 and high y activ- 
ity in a functionally specific manner in humans. This would 
indicate that integration of information within the NAcc could 
rely on transient coupling between frequencies. 

We studied the NAcc activity in three human subjects directly 
by means of subcortical electrodes in a serial reaction time task 
(Nissen et al., 1987) in which the participants had to track and 
respond to a sequence of numeric stimuli in a fixed and a ran- 
dom order condition which modulated different cognitive control 
demands. From Tort et al. (2009) one can hypothesize that PAC 
transiently occurs in the NAcc and is modulated by the level 
of cognitive control. We tested the following hypotheses: PAC 
emerges in the NAcc. Second, PAC discriminates between phases 
of high and low cognitive control. Third, PAC varies systemati- 
cally with behavioral performance measures across experimental 
conditions (high and low cognitive control — HCC and LCC) . 

2. MATERIALS AND METHODS 

2.1. PARTICIPANTS 

3 patients (mean age 38.3 years (SD = 12.34), 2 female, all right 
handed) with a history of intractable epilepsy participated in 
this study. We directly recorded from the bilateral NAcc and 
the anterior Thalamus (ANT). For details on surgery and deep 
brain stimulation approach please see Appendix 6.1 and Table Al 
summarizing the clinical background of the patients. 

2.2. PARADIGM 

We carried out a serial reaction time task (see Figure 1) which 
required a single finger movement that was specified by a numeric 
stimulus presented on a monitor screen. Stimulus presentations 
were controlled by MATLAB. Patients were instructed to respond 
with their right thumb, index finger, middle finger, or little finger, 
which rested respectively on the spacebar, "j," "k," and ";" keys 



of a computer keyboard. Four different numbers (1, 2, 3, 5) were 
presented on the screen (height 2 cm, 0.15° visual angle). These 
numbers indicated the finger they had to use to press the key. 
Six blocks of 60 trials, each comprising the presented number 
and the corresponding finger movement, were conducted with 
each patient. The four numbers were presented in a fixed or ran- 
dom order depending on the block number, with 3 fixed order 
blocks followed by 2 random sequence blocks and a final block of 
self-paced finger movements. In the fixed order blocks a repeti- 
tive sequence of six numbers was presented in all three blocks. In 
sum, the participant performed 30 repetitions of the 6-number- 
sequence. In the random blocks the four numbers were presented 
randomly. In the self-paced block a fixation cross was presented 
instead of the numbers. The participants were not informed about 
the type of sequence. The interstimulus interval (ISI) was vari- 
able and depended on the reaction time of the participants, with 
a fixed time between response and next stimulus of 700 ms plus 
a jitter of ± 110 ms. In this interval the stimulus remained pre- 
sented. Thus, block and trial length depended on the participants 
reaction time (mean block length per participant: PatOl: 117 s 
(std: 18.4), Pat02: 93 s (std: 25.6), Pat03: 96 s (std: 26.03); mean 
trial length per participant: PatOl: 1.6 s (std: 0.52), Pat02: 1.01 s 
(std: 0.31), Pat03:1.03s (std: 0.21). Blocks were separated by a 
1 min rest. During this resting period an X was presented on the 
screen. A + presented for 5 s informed the participant about the 
beginning of a new block. 

2.3. COGNITIVE CONTROL 

These 3 types of sequences (fixed, random and self-paced) dif- 
fered with respect to the need for ongoing monitoring of actions 
and performance outcomes and subsequently, adjustments of 
behavior and learning which we tagged cognitive control in 
accordance to MacDonald et al. (2000) and Ridderinkhof et al. 
(2004). 

2.3.1. Fixed sequence 

The fixed sequence allowed the participant to learn the sequence. 
During the early phase (cognitive phase Fitts et al., 1973) of 
learning, when the fixed sequence is unknown, a high level of 
cognitive control is necessary to establish a strategy to complete 
the task (Fitts et al., 1973) namely to associate the stimulus with 
the response. The longer the training the less necessary cognitive 
control is, since the stimulus-response association was learned 
and the participant knows which finger to move before the actual 
stimulus is presented on the screen. 

2.3.2. Random sequence 

The sudden onset of a novel or unpredictable event captures 
attention and disrupts ongoing performance (Barcelo et al., 
2006). In our experiment switching from the fixed to the ran- 
dom sequence marks such onset of several unpredictable events. 
This interruption of stimulus predictability signals the need for 
a change in strategy from a learned and hence, automatic to 
an unlearned mode. The occurrence of errors makes cognitive 
control necessary which leads to post-error slowing in healthy 
participants and more careful responses after errors (Notebaert 
et al., 2009). Hence, less errors are expected during phases of high 




I II II II II II 1 

FIGURE 1 | Subjects were presented with stimuli indicating which 
finger to move. Each block contained 60 trials (presentation of a single 
number). Colors denote the type of the sequence. Together, the subjects 
were presented with three blocks of a fixed sequence, two blocks of a 
random sequence, and one block in which they could choose a sequence 
on their own. 
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cognitive control. In healthy participants, differences in cognitive 
control are reflected by a reduction of initially long reaction times 
after the completion of several repitions of the 6-item sequence 
of the same fixed sequence (Nissen et al., 1987; Knopman et al., 
1991). The presentation of random sequences after the fixed 
sequences will force the participant to abandon a learning strategy 
and elevate reaction times to a plateau value. 

2.3.3. Self-paced sequence 

During the last block, the participants could chose the sequence 
on their own with no obligation. Since the selected movement had 
not to be adjusted according to an external stimulus we expected 
short reaction times which would indicate less action monitoring 
or cognitive control. In sum, we classified trials of high cognitive 
control (HCC - initial tracking of the fixed sequence and tracking 
the random sequence) and low cognitive control (LCC - tracking 
the learned fixed sequence and during the self-paced sequence). 

2.4. DATA COLLECTION 

Intracranial recordings were obtained using a Walter Graphtek 
(Walter Graphtek GmbH, Ltibeck, Germany) system, with a sam- 
pling rate of 512 Hz, a resolution of 0.25 u,V, and analog band- 
width of 200 Hz. We referenced online to the right earlobe. The 
ground electrode was placed at P8. During recording, a highpass 
filter of 0.19 Hz and a lowpass filter of 240 Hz was used. In the left 
and right NAcc and ANT (a total of 16 recording electrodes), adja- 
cent electrodes were combined with each electrode referenced to 
the neighboring contact (i.e., 1-2, 2-3, 3-4, with "1" representing 
the most ventral and "4" representing the most dorsal electrode 
contact). This resulted in a bipolar montage with each NAcc/ ANT 
monitored by three electrode positions. This montage was used to 
enhance the spatial resolution of the intracranial recordings and 
to ensure that the recorded activity originated from nearby tissue. 

2.5. GENERAL DATA ANALYSIS 

We used Matlab 2008a (Mathworks, Natick, USA) for all offline 
data processing. The resulting time series for the electrodes 
located in the NAcc were segmented in epochs of —1 to 2 s 
relative to the event (stimulus and response). In separate anal- 
yses these epochs were aligned to the motor response or onset 



of the instructive stimulus. These time series were used to 
characterize event-related brain dynamics in terms of PAC. We 
inspected the signal visually for artifacts and decided not to 
reject any epochs. Since we focused on single frequency bands 
we avoided signal drifts by applying bandpass filters for the 
frequency bands of interest (see below). All filtering was done 
using a 4th order butterworth filter (IIR- filter). All steps of data 
analysis were applied also to the recordings from the anterior 
thalamus. 

2.6. BEHAVIORAL DATA 

Two behavioral parameters — reaction times (RT) and error rate 
(p e ) — were assessed as indicators of cognitive control. The DBS 
procedure allows for the recording of only a limited pool of 
subjects (here N = 3). This limited number of subjects may influ- 
ence strongly statistical test results so that effects can be missed 
even though potentially observable in a larger set of subjects. 
An ANOVA comparing RT differences across blocks — which may 
indicate differences in cognitive control — therefore, used RT of 
each trial in each subject as the random variable (n = 180) and 
blocks as factors (p = 6). Reaction times of each subject were z- 
scored across trials. Individual reaction times are summarized in 
Table 1 . The summed number of errors in each participant was 
used to calculate p e for each block except the self-paced block 
(errors cannot be made since the sequence was generated by the 
participant itself) we calculated 





Pe = 


N errors 

Ntrials 




(1) 


Table 1B | Error rate. 


Patient Block # 1 


Block # 2 


Block # 3 


Block #4 


Block # 5 


1 4 


6 


7 


5 


1 


2 1 


1 


2 


4 


1 


3 3 


2 


1 


0 


2 



Table shows the number of errors for each subject and block. 



Table 1A | Reaction times in ms. 



Patient 


Block # 1 


Block # 2 


Block # 3 


Block #4 


Block # 5 


Block # 6 


1 


1027 (301) 


1090 (261) 


1077 (255) 


1108 (284) 


1057 (212) 


645 (395) 


z-score 


0.079 (0.934) 


0.268 (0.786) 


0.229 (0.769) 


0.323 (0.858) 


0.170 (0.640) 


-1.071 (1.191) 


2 


881 (214) 


658 (106) 


628 (146) 


639 (122) 


721 (180) 


210 (182) 


z-score 


0.991 (0.823) 


0.135 (0.407) 


0.022 (0.562) 


0.063 (0.469) 


0.377 (0.692) 


-1.588 (0.700) 


3 


814 (290) 


642 (158) 


604 (148) 


655 (116) 


680 (135) 


510 (191) 


z-score 


0.804 (1.431) 


-0.045 (0.782) 


-0.230 (0.733) 


0.022 (0.574) 


0.143 (0.667) 


-0.695 (0.943) 



The table shows the mean reaction times and standard deviations of reaction times for each subject and block. Each value encompasses 60 trials. Since subjects 
differ in their reaction times (see Results) we z-scored the reaction times across all trials for each subject. This means that individual RTs were transferred into 
standard values by z-transformation individually for each subject. The second row of each patient shows the mean (std) of the z-scored reaction times. The subjects 
showed a different evolution of RTs across the experiment. But this concomitant in each group analysis — that individual subjects show only a trend which resembles 
the result of the group analysis or may slightly deviate from the trend in the group — does not challenge the statement resulting from the ANOVA for a group of 
participants. Even though we could only dispose of a very small group, the trend of behavioral changes in terms of RTs remains. 
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with N errors designating the set of trials with false responses and 
-Ntriak as the total number of trials in a given block. A j 2 test sta- 
tistically compared the blockwisep e . These values were related to 
PAC in a correlation analysis to test the specific hypothesis of a 
functional relationship between PAC and behavioral performance 
(see Section 2.7). 

2.7. FREQUENCY ANALYSIS 

In the first step we analysed whether oscillations show signifi- 
cant amplitude variations following the stimulus or the motor 
response. The rationale was to exclude the possibility that 
expected effects of PAC could be the result of the variation of 
only one frequency. We filtered the epochs in each trial in a broad 
range of frequencies ranging from 4 to 150 Hz (center frequen- 
cies) with a step of 2 Hz (band width of 4 Hz). By means of the 
absolute Hilbert transform we estimated the envelope of the oscil- 
latory activity for each filtered time series in each trial. We then 
grouped the trials according to the HCC and LCC condition (see 
Section: Cognitive Control). In each frequency band and at each 
time point we compared the amplitude values across subjects 
and trials with a f-test. To assess statistical significance we cor- 
rected the significance threshold with a false discovery rate (FDR). 
Therefore, we fitted a cumulative normal distribution function to 
all p-values < the uncorrected significance threshold (p < 0.05; 
see Figure 4). All comparisons between HCC and LCC whose 
p-values < 0.05 in this new distribution were considered statisti- 
cally significant. We furthermore asked, whether the amplitude in 
experimental conditions evolves differently with respect to their 
baseline. In each trial we calculated the differences between the 
baseline (average of 500 ms before motor response) and the aver- 
aged activity in the temporal interval of 500 ms following the 
motor response. We then tested by means of a t-test for differences 
between the experimental conditions (HCC-LCC). 

2.8. PHASE-AMPLITUDE CROSS-FREQUENCY COUPLING (PAC) 
2.8. 1. Calculation of PA C 

To define whether frequencies interact and whether this inter- 
action shows a temporal pattern, we quantified the relationship 
between the phase of the 0 frequency band and the amplitude of a 
high frequency band in a manner comparable to the approach of 
Tort et al. (2009). Specifically, for a given electrode e we used the 
temporal interval i around the button press in the fixed and ran- 
dom sequence trials (N tr ; a i s = 300) since in both the subject had 
to respond according to an external cue. In this interval i we sep- 
arated the 6 oscillation into 30 phase bins (— jt to it; Nbins = 30) 
and calculated the averaged high frequency amplitude within each 
phase bin (see Figure 2A). We filtered the raw signal in the 6 
(4—8 Hz (Axmacher et al, 2010)) band and a high frequency 
band covering the y and high y bands. The high frequency band 
was divided into narrow sub-bands with center frequencies rang- 
ing from 25 to 175 Hz, a bandwidth of 30 Hz and a step size of 
2 Hz. We used the Hilbert transform to estimate the high fre- 
quency amplitude time series and the 9 phase time series. From 
this the amplitude-phase-histograms were derived with the 2jt- 
6-cycle split into 30 phase bins of equal width (0.21 rad or 12°) 
in consecutive temporal intervals. We first calculated the cross- 
frequency spectrogram (amplitude variation of a high frequency 



oscillations as a function of the phase of a low frequency oscilla- 
tion) within each subject. This means that the 0-phase values over 
the temporal interval (166 ms) were sorted into 30 equally spaced 
phase bins. The window size of each temporal interval was set 
such that a full cycle of the center frequency (6 Hz) of the 9 range 
(4-8 Hz) was covered (166 ms). Next, the high gamma amplitudes 
observed at the various time points were separately averaged for 
each phase bin. As the next step in each subject we fitted a cosine 
function to the resulting high gamma amplitude values over phase 
bins. To prove the dependency of the high gamma amplitude on 
a same 9 phase across subjects we averaged the resulting fit func- 
tions (see Figure 2). As the final step in our analysis we statistically 
compared whether more variance is explained by the variance 
across subjects or more variance is explained by the averaged fit 
functions (see next paragraph). If the latter was the case then all 
subjects' high gamma amplitude depended on the same 9 phase 
and the Modulation Index was high. For example, if coupling did 
not rely on the same 0 phase then the variance across subjects 
would be higher compared to the variance across the 9 cycle. In 
sum, first the subject specific electrophysiology was evaluated fol- 
lowed by the statistics within the entire group of subjects in which 
we tested whether despite averaging the fit function more variance 
is explained by the fit function than by the variability across sub- 
jects. The same analysis was also conducted with 2 underlying 6 



B 




FIGURE 2 | Phase-amplitude cross-frequency coupling describes the 
dependency of high frequency amplitude on phase of low frequency 
oscillation. (A) 9 oscillation was separated into 30 phase bins covering the 
entire cycle (— u to jt; red bars). In each bin the magnitude of the high y 
analytic amplitude (green line) of the ongoing high y band (blue line) was 
calculated. (B) Depiction of high y amplitude as a function of 0 phase for 
three subjects (colored asterisks) in one temporal interval. For each subject 
the mean high y amplitude corresponding to each of the 9 phase bins was 
calculated across trials. Afterwards, the variance across the mean over 
subjects (dashed line) was calculated. In the left plot (contralateral NAcc) 
the variance of the high frequency amplitude across the 9 bins is greater as 
compared to the variance across subjects for a given bin resulting in an 
enhanced averaged variance as compared to the ipsilateral NAcc (right plot). 
(C) The variation of high y amplitude as a function of 9 phase was predicted 
by a cosine function assuming a unimodal dependency of high y amplitude 
on the 9 phase. A cosine function was fitted to individual high y amplitudes 
(solid lines) and pooled across subjects (bold black line). In the left plot a 
high modulation index results from higher variation across the 9 cycle than 
amplitude differences between subjects. (D) PAC defines the 9 phase the 
high y amplitude is coupled to. Both plots show the same coupling 
strength, however, with different coupling phases. In the left plot the high y 
amplitude is coupled to the descending part of the 9 cycle whereas in the 
right plot the coupling phase is the ascending part of the 9 cycle. 
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cycles. These analyses yielded roughly the same results, but with a 
poorer temporal resolution. The window of analysis was shifted in 
time by 10 ms between —600 and 600 ms around both the stimu- 
lus and the motor responses. This led to 121 temporal intervals 
(Ninterval)- Subsequently, in each interval the phase -amplitude 
distribution (distribution of high gamma amplitude values across 
theta phase-bins) was averaged across the electrodes separately for 
each hemisphere (contra- and ipsilateral to the performing hand) 
and for stimulus and response alignment. 

2.8.2. Quantification of PAC 

To quantify PAC we used the variance cfp AC of the mean 
high frequency amplitude and the Modulation Index (MI; see 
Figures 2B,C). ffpAC is suited to be an exploratory measure since 
no specific model is assumed. In contrast the MI assumes a 
specific form of dependency of high frequency amplitude on 
the 0 cycle and is defined by the strength of coupling and the 
phase to which the high frequency amplitude is coupled. In 
each temporal interval i we calculated the high y amplitude dis- 
tribution across the 9 cycle per subject. We then averaged the 
high frequency amplitude across participants. This averaged high 
frequency amplitude is shown in Figure 2B as a dashed line. 
We calculated the variance a 2 of the averaged high frequency 
amplitude as a function of the 0 phase 



Njjfaa 



a) 2 



(2) 



with a,- representing the mean high y amplitude for a given phase 
bin across participants and a representing the averaged amplitude 
of fl; over 0 phases.The larger a 2 the larger are the differences of 
the high frequency amplitude at different 0 phases. A high value 
of variance indicates a high concordance of PAC across partic- 
ipants. In Figure 2B we show this for two cases. The left plot 
shows a high variance of the averaged high frequency amplitude. 
The right plot shows that individual fluctuations of the high fre- 
quency amplitude are canceled out in the average. This leads 
to a small variance indicating a lack of coupling. To compare 
across different high frequency bands we normalized the ampli- 
tude values by z-scoring. We used the variance to compare the 
modulation of high frequencies by 0 phase across all anatomi- 
cal regions. Note that a high a 2 only indicates that at different 
0 phases the high frequencies differ in amplitude: it does not 
explain whether the variance of the high frequency amplitudes 
is accounted for the 0 cycle. Therefore, in each high frequency 
showing a significant variance level we determined the goodness 
of a cosine fit (F- value). The cosine function (representing the 
0 cycle) was fitted to the z-scored high frequency amplitude val- 
ues in each subject. The best cosine fit function minimizes the 
sum of squares of errors. We termed the test statistic modulation 
index according to Tort et al. (2009). However, in our analysis the 
MI represents an ANOVA and hence, specifies whether more of 
the variance in the high frequency amplitude (MS cos - explained 
by the 0 cycle) is explained by the variation across the 0 cycle 
or across the participants (MS error — unexplained by the 0 cycle). 
Therefore, we averaged the cosine fit functions across subjects and 



assessed whether despite averaging more variance of the high fre- 
quency amplitude is explained by the 0 cycle than the variance 
across subjects. 

The variance between the 0 phases is given as 



SS a 



dfcc 



(3) 



with SS cos as the sum of squares of high frequency amplitude 
between 0 phases and df cos as the degrees of freedom. The variance 
within the 0 phases is given as 



dferro 



(4) 



with SSerror as the sum of squares of high frequency amplitude 
within 0 phases and df mm as the degrees of freedom. MS el ml takes 
the variability across subjects into account. The MI is given as the 
ratio between both as 



MI ■■ 



MS 0 



MS e 



(5) 



The larger the MI more of the variance in the high frequency 
amplitude is explained by the variation across the 0 cycle than 
across the participants. In fact this MI is comparable to an 
ANOVA which directly compares an effect of a condition (here 
0 cycle) in relation to a random variable (here individual high y 
amplitude values) in each factor of the condition (here each sin- 
gle phase bin of the 0 cycle). If each subject would show coupling 
however, with a strong coupling phase angle shift this would result 
in a low MI. Also strong gamma bursts in one subject and hence 
not a smooth variation of the high gamma amplitude across the 0 
cycle would result in a low MI since the variation across subjects 
increases compared to the variation across the 0 cycle. 

Furthermore, PAC is defined not only by the coupling strength 
but also by the phase of the 0 cycle at which the high gamma 
amplitude reaches its maximum. In Figure 2D we show differ- 
ences in coupling phase with the same coupling strength. Here all 
subjects show strong coupling since the variation of high gamma 
amplitude values in each subject is accounted for the 0 cycle. The 
bold line shows the average of the individual cosine fit functions. 
Despite averaging across subjects more variance is accounted for 
the 0 cycle than for variance across subjects at each phase. In the 
left plot high gamma amplitude is coupled to the descending part 
of the 0 cycle whereas in the right plot the high gamma amplitude 
is coupled to the ascending part of the cycle. The coupling phase 
was estimated by determining the 0 phase where the averaged 
cosine fit function reaches its maximum. 

2.8.3. Statistical test of PA C 

To estimate the empirical distribution of a 2 in each temporal 
interval we calculated the variance of original time series filtered 
in the high y range but randomly shifted in time as a function of 
the original 0 phase in 500 randomizations. The 97.5th percentile 
of this distribution was used as the critical value when apprais- 
ing the significance of our results. To estimate the empirical 
distribution of MI in each temporal interval we calculated the 
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MI on the same set of randomizations as used for a 1 . The 97.5th 
percentile of this distribution was used as the critical value when 
appraising the significance of our results. 

2.8.4. Functional relation between PAC and behavioral performance 

We tested the specific hypothesis that a functional relationship 
between PAC and cognitive control exists. To this end we assessed 
the correlation between both RTs andp,, with PAC. In sliding win- 
dows of 50 consecutive trials with a step of 2 trials we calculated 
the grand average of reaction times ( 1 . average of RT over trials, 2. 
average across subjects) and the p e . In separate analyses we tested 
both behavioral measures p e and RTs for possible correlations 
with MI and coupling phase. 

2.9. PRECLUSION OF 6 PHASE RESETTING 

In each subject we investigated whether the coupling can be 
attributed to a resetting of the 0 phase. At each time point across 
trials in each subject we calculated the phase concentration k of 
circular data which is the reciprocal to the variance in a nor- 
mal distribution to exclude the possibility that PAC results from 
phase realignment of the 9 oscillation across trials. A high K-value 
indicates a preferred G phase across trials at a given time point. 
Statistical significance was assessed by a permutation procedure. 
In 500 runs the trial-wise time series were shifted in time sepa- 
rately. In each run k was calculated. The confidence intervals for 
phase concentration k were derived from the resulting 500 k time 
series. 

2.10. SPECIFICITY OF 0-HIGH y COUPLING 

We furthermore sought to preclude the possibility that the high 
frequency amplitude was coupled to the phase of frequencies 
other than 9. In the 200 ms following the motor response we cal- 
culated the variance of amplitude of all high frequency bands in 
the y/high y range (center frequencies: 55-165 Hz, bandwidth: 
30 Hz, step size: 2 Hz) as a function of the phase of low frequen- 
cies ranging from 3 to 16 Hz (bandwidth: 4 Hz, step size: 1Hz). 
Here, we first calculated the high frequency amplitude distribu- 
tion across the cycle of each low frequency and then averaged 
across the subjects as shown in Figure 2. We then calculated the 
variance of the averaged high frequency amplitude distribution. 
The variance is high if all participants show a comparable distri- 
bution of the high frequency amplitude across the cycle of a given 
low frequency cycle. In contrast, the variance is low if participants 
did not show a comparable dependency of the high frequency 
amplitude on the low frequency cycle. 

3. RESULTS 

3.1. BEHAVIORAL RESULTS 

First, we tested whether the participants performed differently 
throughout the task (see Materials and Methods) indicating dif- 
ferences in cognitive control. We assumed that tracking and 
responding to an unknown (i.e., block 1), a well-learned (i.e., 
block 2-3) or an unpredictable sequence (i.e., block 4-5) call for 
different cognitive control demands. Unknown and unpredictable 
sequences demand a high cognitive control since recent patterns 
cannot be extracted. Differences in reaction times across blocks 
(see Table 1) were confirmed with an AN OVA (_F(5, 1074) = 87.11, 



p < 0.0001; see Figure 3A). Figure 3C shows the mean reaction 
times for each trial bin. Post-hoc paired f-tests confirmed changes 
in reaction time between blocks. These results were summarized 
in Table 2. The relative comparison between blocks shows that 
blocks 2 and 4 show more similar mean RTs than blocks 1 and 
4. However, it is of note that blocks 1 and 2 are statistically dif- 
ferent as well and even though not statistically significant there 
is a trend from block 2 to 3 and all the more important from 3 
to 4. Therefore, the overall trend across the experiments suggests 
that there is a course from HCC to LCC during the second and 
third block to HCC in both random sequence blocks and again to 
LCC in the self-paced block in terms of reaction times. In sum, 
we interpret the results in an absolute way (global course across 
the experiment) given that we recorded behavioral data from (i) 
non-healthy subjects which participated in (ii) only one block due 
to the limited recording time. Furthermore, blocks differed with 
respect to the error rate p e which was confirmed with a j 1 test 
(mean p e per block: 0.044, 0.050, 0.056, 0.050, 0.022, p < 0.005, 




number of trial bin 



FIGURE 3 I Depiction of behavioral results, x-axis: sequence type. 

Numbers within the bars show the number of the block. HCC and LCC 
above the bars indicate the level of cognitive control necessary to perform 
the task (HCC — high cognitive control and LCC — low cognitive control) 
(A) Reaction times were pooled across subjects and trials. Each bar 
encompasses reaction times of 180 trials (1 block). Error bars represent the 
standard error across trials. The color of the bar indicates the sequence 
type as in Figure 1. Trialwise reaction times vary in accordance with 
sequence type. For more clarity post-hoc differences are summarized in 
Table 2. Participants show increasingly faster response with training the 
fixed sequence. Following the fixed sequence reaction times are slower 
during the random sequence. (B) Error rates per block pooled across 
subjects. Error rates are only shown for fixed and random blocks since no 
error can be calculated for self-paced blocks. (C) Depiction of the evolution 
of RT across the trial bins. The error bars in both plots denote the standard 
error of the mean. (D) Depiction of the evolution of error rate across the 
trial bins. The error bars in both plots denote the standard error of the mean 
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Table 2 | Post-hoc statistical f-tests. 
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f-value 
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1.52 
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0.82 


2-5 


— 1.54 


0.12 


2-6 


13.41 


<0.0001 


3-4 


-1.8 


0.06 


3-5 


-3.05 


0.002 


3-6 


12.04 


<0.0001 


4-5 


-1.33 


0.19 


4-6 


13.73 


<0.0001 


5-6 


14.72 


<0.0001 



The left column shows which blocks were tested. The middle column gives 
the t-value for significance of mean differences and the right column the 
corresponding p-value. 



please see Table A2 for the pairwise comparisons). Figure 3B 
shows the continuous increase oip e from block 1 (HCC) to block 
3 (LCC) and a decrease of p e from LCC to HCC in block 4 and 
5. Note, in the self-paced block 6 no errors could be made and 
hence p e could not be calculated. In Figure 3D we show the error 
rate for each trial bin. 

3.2. AMPLITUDE VARIATION 

To exclude the possibility that PAC results can solely result from 
significant amplitude variations in one frequency we compared 
amplitude variations in a broad range of frequencies ranging from 
6 to high y, which neither for the amplitude variation at each time 
point nor the test for different evolution with respect to the base- 
line passed the significance threshold FDR-corrected for multiple 
comparisons (see Figure 4). 

3.3. HIGH y AMPLITUDE VARIES AS A FUNCTION OF 6 PHASE IN THE 
CONTRALATERAL NAcc 

Our general hypothesis was that the high y amplitude varies 
as a function of 9 phase in the NAcc. We tested the statis- 
tical significance of crp AC in the bilateral NAcc and the bilat- 
eral ANT associated both with the numeric stimulus and the 
response. We found an increase in cTp AC shortly after the motor 
response solely in the contralateral NAcc (see Figure 5) but not 
in the ipsilateral NAcc nor in the ANT. Figure 6 specifically 
shows Cp AC and MI for the contralateral NAcc. The increase in 
the contralateral NAcc was statistically significant, exceeding the 
97.5th percentile of our computed distribution of gamma vari- 
ances cfp AC (CI97.5 = 0.57; Figure 6A). By calculating the MI we 
then tested whether the variance of the high frequency ampli- 
tude is accounted for the 9 cycle (see Figure 6A). As for <Xp AC 
we found an increased MI following the motor response. The 
increase in the contralateral NAcc was statistically significant, 
exceeding the 97.5th percentile of our computed distribution of 



MIrandom (CI97.5 = 18, see Figure 6A). The increased 0p AC of 
high gamma (100-140 Hz) amplitude in the contralateral NAcc 
could be accounted for the 6 phase. This coupling was absent 
for the ipsilateral NAcc and following the stimulus, as well. We 
assumed that this is a result of different reaction times between 
subjects [F(2, 1077) = 136.54, p < 0.0001]. We furthermore veri- 
fied that coupling was restricted to the 9-high y interaction (see 
Figure 12) and that an increase of coupling could be found in 
each subject (see Figure 13). The individual coupling patterns 
all show a different temporal layout following the coupling on 
the population level. However, only in the temporal interval of 
coupling on the population level in all subjects the MI tends 
to increase. 

3.4. COUPLING STRENGTH REFLECTS COGNITIVE CONTROL 

Our second question was whether the MI changes as a function 
of cognitive control. We tested this for the MI between 9 (4-8 Hz) 
and high gamma band ( 1 12-142 Hz) since both bands showed the 
strongest coupling increase collapsed across all trials. An initial 
comparison of the MI in HCC versus LCC trial bins (each con- 
taining 10 non-overlapping trials) revealed that MI is significantly 
greater in HCC trial bins (f 16 = —2.54; p = 0.016, see Figure 7). 
In the next step we tested whether the MI shows a systematic vari- 
ation as a function of the experimental condition (HCC: block 1, 
4, and 5 and LCC: block 2, 3, and 6). Therefore, we calculated the 
MI for the contralateral NAcc for each temporal interval across 
trial bins. Trial bins contained 50 trials with a step size of 2. Thus, 
we calculated the MI first for the trials 1-50, then for trials 3- 
53, and continued until trial 300-349 (see Figure 8A). Between 
0 and 200 ms we determined when the maximal MI occurred. 
In periods of high cognitive control (HCC) the MI exceeded 
the statistical significance threshold (see Figure 8B). Coupling 
decreased in the low cognitive control condition (late fixed trial 
bins and final self-paced movement block). Importantly, cou- 
pling peaks earlier during the LCC sequences (mean coupling 
time = 90 ms) compared to HCC sequences (mean coupling time 
= 140ms, see Figure 8C; t g9 = -8.27, p < 0.1-12). The point in 
time of maximal coupling and MI covaried significantly (r = 0.7; 
p < 0.0001 see Figure 8D). Note, that differences in MI can- 
not be explained by longer RTs since trials were aligned to the 
motor response. 

3.5. FUNCTIONAL RELATION BETWEEN PAC AND BEHAVIOR 

3.5. 1. Ml correlates with error rate 

A further strong indication for functional relation between PAC 
and behavior would be provided by a covariation of MI with 
performance. It is assumed that the NAcc is engaged in action 
monitoring. We assume that high cognitive control allows for 
high action monitoring which should result in a low probabil- 
ity of making an error. In contrast, low cognitive control should 
result in a comparatively high probability of making an error. We 
therefore tested whether the PAC represented by the MI (cou- 
pling strength) or the coupling phase predicts the probability 
of making an error p e or reaction times. To achieve a contin- 
uous measure in the consecutive trial bins containing 50 trials 
as described above we calculated p e . Subjects showed on aver- 
age a reduced p e at the beginning of the experiment and while 
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FIGURE 4 | (A) Depiction of local field potentials locked to the response 
and the stimulus presentation both for the contra- and ipsilateral 
recording sites. The LFP in each trial was filtered between 3 and 200 Hz. 
Each colored line represents one subject. (B) Depiction of spectrograms 
for the low cognitive control condition (left-LCC) and the high cognitive 
control condition (right-HCC). In each subject we estimated the 
spectrogram by means of the Hilbert transform. In each trial aligned to 
the motor response/stimulus, we calculated the envelope of the bandpass 
filtered time series (4-150 Hz, bandwidth: 4 Hz, step: 2 Hz). The upper 
plots show the average across subjects and trials both aligned to the 
response and the stimulus in the HCC and LCC. For a better comparison 
of the amplitude across frequencies the spectrogram was z-scored for 



depiction only. All analysis were conducted on the non-standardized time 
series. The colorbar denotes the strength of amplitude in |iV (z-score). 
(C) depicts the statistical evaluation by means of a f-test. At each time 
point in each frequency we calculated the p-value for the difference 
between LCC and HCC across subjects and trials (left plot). The right 
plot shows the time points and frequencies with a p-values < 0.05 (blue) 
on an uncorrected significance threshold. We corrected for multiple 
comparisons by taking the distribution of p-values < 0.05 into account. 
The 0.05% confidence interval of this new distribution (last row) served 
as a new significance threshold. Note that no p-value fell below this 
threshold indicating that between the HCC and the LCC condition no 
significant difference in amplitude modulation was found. 



performing the random trials where the modulation index was 
high, which accords with the view that action monitoring is high 
when subjects first begin to track the fixed sequences and during 
the random sequences (HCC). The MI was significantly corre- 
lated with p e (r = —0.21; p < 0.05). Additionally, since the trial 
bins were not statistically independent we determined the signifi- 
cance of Pearson's correlation coefficient r against the distribution 
of r values calculated from 500 shuffles of trials. We found that 
the observed r value could not have been derived from a chance 
distribution (p = 0.01). This indicates a statistical significance. In 
Figure 9 we depict the p e averaged across our three subjects (gray 
curve) together with the MI (blue curve). In contrast, MI did 



not vary with reaction times in the same trial bins (r = —0.15; 
p > 0.05). 

3.5.2. Coupling phase correlates with reaction times 

Hasselmo et al. (2002) proposed a model of the functional rel- 
evance of the rat hippocampal 9 rhythm in which the encoding 
and retrieval of memory information occur in different phases. 
He argues that this mechanism is important for the reversal 
of prior learning. Furthermore, we tested whether the coupling 
phase varies as a function of cognitive control. In each trial bin 
we determined the point in time of maximal MI, and evalu- 
ated the cosine function which served as the basis for the MI. 
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FIGURE 5 1 Depiction of the variation of high y amplitude 
across 6 cycle for bilateral NAcc and bilateral anterior 
Thalamus. The recorded time series in the contra- and ipsilateral 
NAcc and Thalamus were aligned to the motor response or the 
instructive stimulus. In each frequency band ranging from 25 to 
175 Hz (centerfrequencies) we calculated the variance of high 



frequency amplitudes across the 9 cycle (4-8 Hz) as a function of 
time. Variance increased significantly solely following the motor 
response in the contralateral NAcc (p-value corrected for the 
number of recording sites). Variance values corresponding with a 
p-value smaller than p corr are depicted color-coded ranging from 
blue (small variance) to red (high variance). 
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FIGURE 6 | Depiction of 8-high y PAC for the contralateral NAcc. (A) The 

first row gives the a 2 as a function of time (x-axis) and frequency 

(/-axis). (B) The second row shows the modulation index. The second 
column shows the frequency band N100-140 Hz; red line) with significant 
increase of a 2 and PAC. The blue lines denote the 97.5th percentile 

(tfy/9) 

used as confidence interval of the normal distribution for a 2 and 
F-distribution for Ml. Note that the variance and the Modulation index 
exceeded the significance threshold for more than 200 ms and each point is 
the result of a temporal interval of 166 ms. This means that coupling is 
present in non-overlapping temporal intervals and hence, extents across 
several cycles. 
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FIGURE 7 | The modulation of the high y frequency by the 0 phase differs 
between trials with low (LCC) vs. high (HCC) cognitive control 
(p < 0.05). The modulation index was calculated in non-overlapping trial bins 
of 10 trials. In trial bins containing only trials from the HCC condition the 
modulation was enhanced compared to trial bins of LCC trials. Error bars 
denote the standard error across trial bins. *p < 0.05. 



The 9 phase that corresponded with the maximal value of the 
cosine function representing the peak of the high y amplitude 
was taken to be the coupling phase. We found the coupling phase 
discriminates between trial bins of HCC and LCC (see Figure 10). 
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FIGURE 8 | Coupling strength varies with sequence type (A) Variance of 
high y as a function of 0 phase (upper plot) and modulation of high y by 0 
phase (lower plot). Both plots show the variance and the modulation as a 
function of time (x-axis) and trial bin (y-axis). Trial bins are arranged from top 
to bottom. Both show that across subjects coupling is elevated at the 
beginning of the fixed and during the random trials. For consecutive trialbins 
each containing 50 trials we calculated the modulation index. Following the 
motor response the Ml varied with sequence type. The sequence type is 
indicated by the colored bar left to the magnification: black corresponds to 
fixed, red to random and blue to self paced trials. The alternating red-black 
bar denotes those trialbins containing both fixed and random trials. Note that 
including only a small proportion of random trials elevates the modulation 
index. Alternating blue-black bar denotes those trialbins containing both 
random and self-paced trials. (B) Depiction of points in time at which 
modulation peaks for trialbins. The right panel shows the dependency of 



maximal modulation index on trial bin in the 0-200 ms interval (see Figure 5 
right column ) following the motor response. (C) In fixed trials coupling is 
earlier then in random trials. Only trial bins containing either fixed or random 
trials were used in this analysis. (D) Time of coupling between 9 and high y 
depends on coupling strength. (E) shows the individual summed square 
errors of each subject from the mutual cosine fit function as a function of trial 
bin. The greater error of subject 1 does not mean that this subject does not 
exhibit a sine shaped dependency of the high gamma activity as shown in 
Figure 2C. As the blue line deviates more strongly from the black bold line 
compared to the red and green line the summed mean error is greater than 
for subjects 2 and 3. However, it shows a clear sine shaped dependency. This 
means that subject 1 either contributes less to the strength of the Ml or 
probably attenuates the Ml but this does not challenge the visual impression 
that the high gamma amplitude is coupled to a resembling phase as subject 
2 and 3. *"p < 0.001. 



In trial bins containing fixed trials the mean 9 phase is 1.72, 
while for random trials it is 2.29. A Watson-Williams test for 
circular data confirmed the significance of this coupling phase 
difference (F(i j 99) = 23.6; p < 0.0001). Again, since the phase 
scores of each trial bin are not statistically independent, we calcu- 
lated the significance of phase differences against the distribution 
of F values calculated from 500 shuffles of trials. We found that 
the observed p value could not have been derived from a chance 
distribution (p < 0.0001). As for the MI we tested whether the 
change of phase as a function of cognitive control has a signif- 
icance for the observed behavior. We used p as the correlation 



coefficient between one circular and one linear random variable. 
In contrast to the MI we found the coupling phase is signifi- 
cantly correlated with the reaction times (p = 0.55, p < 0.001; 
see Figure 10A). p could not have been found within the set of 
500 trial shuffles (p < 0.001). However, the coupling phase did 
not predict pe (p = 0.15,p > 0.05). 

Note that there is a slight phase angle shift between the sub- 
jects. However, as revealed by the MI, this phase shift does not 
influence that more variance is explained by the variation across 
the theta cycle than between subjects. This is explicitly considered 
in our MI measure. In trial bins (see paragraph on Functional 
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FIGURE 9 | Coupling strength predicts the probability to make an error 
as indicated by the correlation analysis. Here we depict both correlated 
measures to illustrate the resembling course over time. The gray line gives 
the probability to make an error across subjects. The blue line shows the 
Modulation Index. 



Relation between PAC and behavioral performance) of HCC 
(long reaction times and a low error rate as at the beginning 
of the experiment and during random sequence trials) subject's 
coupling phase is the same, namely around the trough of the 9 
oscillation (see Figure 10B). In contrast, during phases of LCC 
(during late trials of the fixed sequence and during self-paced 
sequence trials) subjects show a great variation of the coupling 
phase. This is indicated by the greater errorbars during trialbins 
of LCC (see Figure 10B). In each trial bin we grouped the high 
gamma amplitude according to the 30 9 phase bins for the tempo- 
ral interval ranging from 0 to 200 ms. We fitted a cosine function 
to the resulting 30 high gamma amplitude values. The coupling 
phase of the 9 oscillation was defined as the phase at which the 
high gamma amplitude was maximal. This leads to 3 coupling 
phases one per each subject in each trial bin. To better illustrate 
the in-phase coupling we collapsed the rising and the falling part 
of the 9 cycle. Therefore, the y-axis in Figure 10B ranges from 0 (9 
peak) to ±7t (6 trough). The x-axis gives the number of trial bins. 
The upper plot in Figure 9B shows the average and the standard 
error (error bar) of coupling phases across subjects for each trial 
bin. The red line shows the standard error. This line demonstrates 
that the standard error across subjects is low in trial bins of HCC 
and high in trial bins of LCC. 

3.6. 6 PHASE RE-ALIGNMENT 

We tested for each subject whether PAC results can be a mere 
result of theta phase re-alignment. Here, we compared the phase 
concentration of the 9 oscillation with an empirical distribution 
(see Materials and Methods). We did not find a statistically signif- 
icant phase re-alignment in none of the subjects neither following 
the stimulus nor the motor response (see Figure 11). 

3.7. SPECIFICITY OF 6-HIGH y COUPLING 

We tested whether 9 and high gamma activity exclusively show 
coupling or whether other frequency combinations also show 
coupling. We found the variance of the high frequency bands 
(^100-140 Hz) across the phase of the 9 (4-8 Hz ) band was 
higher than any other frequency combination (see Figure 12). 
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FIGURE 10 | (A) Cognitive demands in different sequence types are 
reflected by difference in coupling phase. In each trialbin we determined 
the modulating phase of the 6 cycle. Black dots denote the phase the high 
y amplitude is coupled to for each trial bin. The sequence type is indicated 
by the colored line: black corresponds to fixed, red to random and blue to 
self paced trials. The alternating red-black line denotes those trial-bins 
containing both fixed and random trials. Alternating blue-black line denotes 
those trial-bins containing both random and self-paced trials. Phase 
differences were investigated comparing trial bins containing exclusively 
fixed and random trials, respectively (solid black and solid red intervals). 
Black arrows mark the mean 9 phase. Coupling phases differ significantly 
between fixed and random trial bins. Please note that at the beginning of 
the entire experiment, when the sequence to be learned is unknown high 
gamma amplitude peaks at the same frequency as during the unpredictable 
random sequence. (B) During HCC high gamma amplitude is coupled to the 
9 trough across subjects while during LCC the coupling phase is different 
across subjects as indicated by the greater errorbars during trialbins of LCC. 
In each trial bin we grouped the high gamma amplitude according to the 30 
9 bins for the temporal interval ranging from 0 to 200 ms. We fitted a cosine 
function to the resulting 30 high gamma amplitude values. The coupling 
phase of the 9 oscillation was defined as the phase at which the high 
gamma amplitude was maximal. This leads to 3 coupling phases one per 
each subject in each trial bin. To better illustrate the in-phase coupling we 
collapsed the rising and the falling part of the 9 cycle. Therefore, the y-axis 
ranges from 0 (9 peak) to ±jt (9 trough). The x-axis gives the number of trial 
bins. The upper plot shows the average and the standard error of mean 
(SEM) of coupling phases across subjects for each trial bin. To better 
visualize this dependency of the SEM on the cognitive control we inserted 
the course of SEM over trial bins (red line) shows the standard error. This 
line demonstrates that the standard error across subjects is low in trial bins 
of HCC and high in trial bins of LCC. 



This yields a comparable narrow frequency interaction as found 

by Tort et al. (2008). 

4. DISCUSSION 

4.1. SUMMARY OF RESULTS 

We investigated the dynamics of PAC in the human NAcc and 
show, that in the NAcc contralateral to a movement the 9 phase 
modulates the high gamma amplitude (~ 100-140 Hz) following 
a motor response. Importantly, this previously undescribed oscil- 
latory pattern in the human NAcc increases with cognitive control 
and predicts behavioral adaptation as reflected in the reduction 
in error rates. Compared to reaction times the error rates show a 
more sluggish change which may explain the resemblance of the 
error rate if averaged across blocks. This means that changes in 
terms of RTs are more closely confined to the definition of blocks 
while the error rate changes with a greater time lag. However, 
the temporally resolved course revealed strong changes during the 
course of the experiment. We observed the strongest PAC in the 
first part of a task in which subjects responded to an unfamiliar 
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FIGURE 11 | Depiction of theta phase concentration as a function of 
time (red line) together with the confidence intervals derived from a 
permutation procedure (black lines). The upper plot shows the 
concentration parameter k as a function of time for trials aligned to the 
stimulus. The lower plot shows the same for trials aligned to the response. 
High concentration values indicate a preferred 8 phase across trials at a 
given time point. Concentration values exceeding the upper confidence 
interval would indicate a statistically significant alignment of the 9 phase 
across trials. In both plots no significant 9 phase alignment can be 
observed. 
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FIGURE 12 | Coupling following the motor response is restricted to the 
9 and high y range. In the time range between 0 and 200 ms (see A right 
column) we calculated coupling strength between narrow high frequency 
bands (centerfrequencies: 50 to 180 Hz, bandwidth: 30 Hz, step size: 2 Hz) 
and narrow low frequency bands (centerfrequencies: 3 to 16 Hz, bandwidth: 
4 Hz, step size: 1 Hz). 



fixed order stimulus sequence, and during responses to stimuli 
presented in a random order that required high load of cogni- 
tive control. In contrast, in periods with low cognitive control 
demands, i.e., when subjects responded to already learned stimu- 
lus sequences and during self-paced sequences, PAC was reduced. 
This pattern of response locked PAC cannot be accounted for 
reaction time differences since analyzed epochs were locked to 
the subject's responses, and no PAC was observed when epochs 
were locked to the stimulus presentations. Hence, coupling takes 
place in the temporal interval following a decision. This pattern 
is consistent with coupling patterns observed in rats by Tort et al. 
(2008). These investigators found enhanced coupling between 6 
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FIGURE 13 | Depiction of subject specific Mis in the contralateral NAcc 
following the motor response. Each line represents the modulation index 
as a function of time of one subject. 0 marks the response time. Following 
the motor response in each subject an increase of modulation strength is 
observable. The black bars represent the upper confidence intervals derived 
from a permutation procedure in each subject. Following the motor 
response in each subject a statistically significant coupling was found. 



and high gamma (80-120 Hz) within and between the striatum 
and the hippocampus. Coupling was strongest in epochs where 
a decision had to be made and thus were related to cognitive 
demands. Tort et al. (2008) hypothesized that PAC is a mechanism 
coordinating striatal and hippocampal learning circuits. As men- 
tioned above, the hippocampus is strongly connected with the 
NAcc and a selective strengthening of this connection is assumed 
to be important for rapid facilitation of goal-directed behavior 
(Goto et al, 2005). The result that PAC decreases with learn- 
ing indicates that PAC is related with the facilitated goal-directed 
behavior as proposed by Goto et al. (2005). That PAC occurs 
whenever a high level of cognitive control has to be applied sup- 
ports the notion that PAC qualifies for facilitation. Thus, our data 
indicate that PAC can be a mechanism of information integra- 
tion, since it occurs during high cognitive control supporting the 
hypothesis that PAC provides an effective mechanism to recruit 
local networks from functional related global networks to gate 
information (Buzsaki et al., 2004; Canolty et al., 2006). 

4.2. INTERPLAY OF FREQUENCIES FOR INTEGRATION OF 
INFORMATION 

It is assumed that the control of motor behavior in NAcc is 
accompanied by release of dopamine (Wilson et al., 1983). Miinte 
et al. (2007) found the human NAcc involved in error-related 
modulation which preceded scalp error- related negativity (ERN). 
On a behavioral level NAcc activity inhibits specific conditioned 
motor behavior (Wilson et al, 1983). In the present study the 
patients probability of making errors systematically varies dur- 
ing the course of the experiment. This variation matches with the 
course from HCC to LCC to HCC and again to LCC. We hypoth- 
esize that the variation of making errors signals a change in motor 
behavior and hence points to adaptation to the external demands 
as a result of learning. The error probability was especially low at 
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the start of the experiment and during the random sequence task. 
The PAC in the contralateral human NAcc correlates with this 
change, which suggests that theta/high gamma coupling strength 
might be related with adaptation of behavior in later trials. This 
gains support by the PAC modulation occuring in early trials 
followed by behavioral adaptation. Once adapted in terms of reac- 
tion times and error rate no PAC modulation takes place. Thus, 
we speculate that the control for a specific action or motor rou- 
tine as during an unknown or random sequence can be provided 
by enhanced coupling of 6-high gamma oscillations in the NAcc. 
This increased coupling becomes important when a subject has 
to switch from a previously established and automized motor 
routine to an unpredictable motor sequence. In contrast, a reduc- 
tion in coupling, as observed during the tracking of the learned 
sequence, might facilitate automization. In our study enhanced 
action monitoring is especially important during learning of the 
fixed sequence and during the random sequence, since automatic 
behavior has to be interrupted. To achieve this, the NAcc has 
to integrate information between different cerebral units. This 
could be the information necessary to control the gating into 
the motor system from the limbic system and the prefrontal 
cortex (Mogenson et al, 1980). The NAcc neuronal activity is 
mutual depend on hippocampal input (O'Donnell et al., 1995) 
as well as PFC activity (French et al, 2002). Thus, the com- 
plex connections with limbic, prefrontal and motor structures 
make the NAcc an ideal site for the integration of informa- 
tion which is supported by the phase-amplitude cross-frequency 
coupling mechanism. 

4.3. PAC IS STRONGEST FOLLOWING A DECISION 

Tort et al. (2008) reports that in the rat's striatum and hip- 
pocampus PAC was strongest during the decision phase while 
rats navigated through a maze. In contrast, in our experiment the 
period of movement was short because there was only a single 
button press. This can explain differences in the timing of PAC 
patterns. In the present study, PAC occurred shortly after the deci- 
sion was made and correlated with the probability of making an 
error, suggesting that changes in response selection based rela- 
tive to past experiences calls for the coordination of information 
carried by different frequencies. Based on our results, we pro- 
pose that the human NAcc signals the unpredictability of a future 
external event to which a response will have to be given, thereby 
indicating the necessity of stopping an automated response. This 
is accomplished by integrating information in the 0 and high 
gamma band. In support of this contention Berns et al. (2001) 
found the reward system and especially the human NAcc respon- 
sive to different levels of predictability. In particular, the NAcc 
was more active during an unpredictable sequence, in line with 
our finding that PAC was elevated at the beginning of learn- 
ing and during the tracking of the random sequence. Further, 
O'Donnell et al. (1995) found differences in activity in the stria- 
tum, especially in the putamen and the nucleus caudatus adjacent 
to the NAcc, for automated vs. unfamiliar motor behaviors. The 
increased coupling following a decision under a condition of high 
cognitive control might represent a type of associative memory 
which combines information about events (button press) and the 
context (stimulus presentation) (Tort et al, 2009). Here one can 



image that the association which is acquired more easily under 
higher cognitive control provides the subject with the possibil- 
ity to respond faster. Furthermore, we observed two patterns of 
the course of coupling. In the first, coupling decreased during 
fixed trials and in the second coupling increased during random 
trials and both differ with respect to the predictability of the 
upcoming event and hence which finger to move. This says that 
during fixed trials the subjects are informed based on the mem- 
ory of past trials which finger is to move and hence the finger 
movement options are limited to one finger. In contrast in the 
random trials the subject has to hold up three finger movement 
options (3 since 4 different stimuli are presented with the con- 
straint that no stimulus was consecutively repeated twice). This 
might also explain why PAC increases constantly during random 
trials. Alternatively, this pattern can be a result of the monitoring 
of the recent action which is underscored by the temporal rela- 
tion. This interpretation is supported by the involvement of the 
human NAcc in action monitoring — the error detection and cor- 
rection (Miinte et al, 2007). The correlation of the modulation 
strength with the error rate indicates that NAcc activity is involved 
in action monitoring. Action monitoring in turn involves a com- 
parison between the representations of an appropriate response 
and the response actually made (Scheffers and Coles, 2000). These 
diverge if a response error was committed. Error monitoring is 
accompanied by prominent scalp potentials (Nieuwenhuis et al., 
2001) and the activity in the NAcc is involved in error- related 
modulations (Miinte et al., 2007) . The authors have shown that 
the early surface potential which indicated the error detection 
was preceded by NAcc activity. Accordingly, activity in the NAcc 
should contribute to ERN when the error rate is high. Moreover, 
the NAcc activity involved in error detection should occur ear- 
lier than the PAC modulation since the error signal on the scalp 
level is evoked around 100 ms and is delayed by the NAcc by 
about 40 ms (Miinte et al., 2007). Importantly, PAC modulation 
occurs when the error rate is small. This makes the PAC a comple- 
mentary event to the error-related modulation. We speculate that 
PAC modulation occurs when the comparison process between 
the appropriate and the actual response revealed that no error 
was made. Therefore, PAC could be the signal involved in con- 
firmation of the correct response which facilitates goal-directed 
behavior in later trials. Due to the vicinity to the motor response 
one could argue that PAC is a mere mechanical artifact, how- 
ever coupling is observed only in one region and shows a tight 
functional correlation with behavioral measures. Furthermore, in 
case of an artificial result we expected coupling to be represented 
across a broad band of low coupling and high coupled frequen- 
cies. However, coupling was restricted to the 9 - high gamma 
range. Hence, we precluded PAC to be a result of an artifact as 
a possible explanation. Based on this, we speculate that PAC in 
the NAcc signals a deviation from expectancy: a negative rein- 
forcement that implies the need to stop an automated motor 
routine in which learned responses are pre-activated to reduce 
reaction times. 

4.4. DIFFERENCES IN COUPLING PHASE 

During the course of the experiment the coupling phase of 6 oscil- 
lations varied systematically, with coupling close to the 6 trough 



Frontiers in Human Neuroscience 



www.frontiersin.org 



October 2013 | Volume 7 | Article 635 | 13 



Durschmid et al. 



Frequency coupling in the NAcc 



during early learning and tracking the random sequence (high 
cognitive control), and coupling to the descending part of the 9 
cycle during tracking a well-learned fixed sequence (low cognitive 
control). A comparable result was found in a study conducted by 
Belluscio et al. (2012). In this study high y activity (90-150 Hz) 
peaked near the 6 trough during running but was coupled to 
the peak of the 0 oscillations during REM-sleep. The authors 
hypothesized that modulation of the high gamma band by the 
0 band is state dependent. Here, we show that coupling in the 
human NAcc is also state dependent. The average coupling phase 
varies as a function of cognitive control applied by the sub- 
jects and parallels the results of Belluscio et al. (2012). This 
strengthens our hypothesis that PAC might provide a mecha- 
nism to integrate information. Hasselmo et al. (2002) highlighted 
the functional importance of different phases in the 9 cycle 
for memory with the descending phase necessary for retrieval 
of memory and the trough for encoding of new information. 
They state that encoding of new information is facilitated if 9 
activity shifts in phase to accelerate the process of encoding. In 
our study when new information has to be encoded and the 
motor response has to be adjusted due to the new environmental 



requirements we observe strong coupling of the high gamma 
activity to the 9 trough. The epochs in which new information has 
to be encoded are the trials in the early part of the fixed sequence 
and the random sequence which differ from the trials late in 
the fixed sequence with respect to the possibility of memory 
retrieval. Retrieval is only possible when the fixed sequence has 
been learned distinguishing between the two distinct cognitive 
states. 

5. CONCLUSION 

Together these results show that motor learning is accompanied 
by a complex interplay of 9 and high gamma activity. In the NAcc 
contralateral to the performing hand the coupling of these fre- 
quencies varies systematically with the experimental conditions 
which allowed the participants to perform differently. 
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6 APPENDIX 

6.1 PROCEDURE: SURGERY AND DEEP BRAIN STIMULATION 

We performed a bilateral stereotactically guided implanta- 
tion of quadripolar brain electrodes (model 3387, Medtronic, 
Minneapolis, MI, USA) in the Nucleus Accumbens (NAcc) and 
in the anterior nuclear group of the thalamus (ANT) of 3 patients 
for treatment of a longterm pharmacoresistant epilepsy. General 
anesthesia was employed during the surgery. The implantation 
was conducted due to clinical reasons and as part of the treatment 
of the epilepsy. 

Treatment planning standards and the surgical procedure are 
described elsewhere in detail Voges et al. (2002). Briefly, the target 
for the deep brain stimulation electrode was defined using stan- 
dard coordinates as the point 2 mm rostral to the anterior border 
of the anterior commissure at the level of the mid-sagittal plane, 
3-4 mm ventral and 6-8 mm lateral of the midline (Mai et al., 
2004), with these coordinates modified according to individual 
planning MRIs. An important landmark is the vertical limb of 
Broca diagonal band, which can be clearly visualized in coronal 
MRI-scans. The target was placed 2-0.5 mm lateral to this struc- 
ture. Using a deep fronto-lateral approach, the two distal contacts 
of the DBS-electrode were placed in the caudo-medial accum- 
bens, the third contact within the transition-area medial to the 
border of the abutting internal capsule, and the fourth highest 
contact in the most medial part of the capsule or in the transi- 
tion area to the caudate. The contacts within the NAcc are placed 
in the caudo-medial part, which according to histochemical crite- 
ria represents the remnant of the shell area in the primate (Sturm 
et al., 2003). In contrast to rodents, in the primate the shell area 
has regressed and is no longer clearly distinguishable, except by 
the typical receptors that it carries. 

In addition, electrodes were implanted in the bilateral ante- 
rior nuclei of thalamus (ANT) of all the patients. The anterior 
thalamic nucleus is located 5 mm lateral to and 12 mm above the 
midcommisural point according to the Schaltenbrand atlas. Since 
the anterior nucleus of the thalamus is readily visible on the floor 
of the lateral ventricle in MRI images, the exact location of this 
target could be directly specified in each patient. Intraoperatively 
the localization of the leads was documented by stereotactic x-ray 
imaging using x-ray tubes installed in the OR. 

In addition, we performed postoperative CT-examination 
(2 mm slice thickness). After a transformation of postoperative 
CT- and X-ray images to align them with the stereotactic treatment 
planning-MRI, we defined the stereotactic coordinates of each 
electrode lead contact and visualized these anatomical positions on 
corresponding sections of two stereotactic brain atlases of (Morel 
et al, 2007). The localization of the electrodes is depicted in 
Figure Al. To further indicate the coordinates of the most caudal 
NAcc electrode, we transformed all patients MRI images to MNI- 
space. The resulting individual MNI coordinates were (x, y, z): Pat 
01: left (-6.9 5.2 -11.9), right (4.3 5.4 -10.4); Pat 02: left (-8.6 
3.5 -8.6), right (9.6 3.7 -9.6); Pat 03: left (-8.3 7.5 -1 1.0), right 
(—6.2 7.3 — 11.0). Postoperatively the electrode leads were external- 
ized to allow electrical test stimulation with different parameters 
and recording from the depth contacts during different psycho- 
logical tasks. Finally the four electrode-leads were connected 
to a single impulse-generator (IPG; Activa-PC, Medtronic) 
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FIGURE Al | Anatomical location of bilateral NAccs. 



Table A2 | post-hoc statistical analysis of the error rate. 
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The p-values refer to the pairwise comparisons of frequency by means of the x 
of the summed number of errors across subjects per block. 



placed subcutaneously beneath the right clavicle. To evaluate 
our hypotheses we analyzed data from the bilateral NAcc elec- 
trodes. To provide evidence of the specificity of our results for 
the NAcc we also performed a control analysis of the recordings 
from the bilateral thalamus. We found results described for the 
contralateral NAcc were not duplicated in the thalamus. 



Frontiers in Human Neuroscience 



www.frontiersin.org 



October 2013 | Volume 7 | Article 635 | 17 



